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ABSTRACT 


Modern  deelelon-wakars  usinff  the  systematic 
approach  known  as  syateas  analysis  as  a  decision¬ 
making  tool  are  faeed  with  the  delicate  problem  of 
choosing  the  correct  aethod  of  analysis  and  applica¬ 
tion  of  resources  to  this  analysis  effort.  This 
study  examines  the  broad  concept  of  systems  analysis. 
The  application  of  two  sethods  of  analysis,  ooat- 
offectlveness  and  the  pay  off  table.  Is  Illustrated. 
It  concludes  that  an  understand!^  of  the  factors  a 
deal  ilcn-maker  must  consider  In  saleotimr  the  method 
and  extent  of  anilysls  effort  is  necessary  In  order 
to  perform  fruitful  analysie  af forte. 
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PR  B  PACK 


This  study  investigates  ths  overall  diagnosis 
required  of  military  and  civilian  managers  when 
selecting  ths  ssthod  and  extent  of  analysis  effort 
required  to  aooompllsh  their  baa to  objectives.  The 
writer  bellsvas  that  eontrary  to  popular  belief,  systems 
analysis  requires  osreful  examination  of  basic  objec¬ 
tives  and  efficient  application  of  all  resouroes  to 
achieve  desired  objectives. 

The  writer  ohose  thli  area  primarily  as  a  result  of 
the  ohallenrre  Issued  by  Lfc  General  John  W.  Carpenter  III, 
Comnander,  Air  University,  In  an  address  to  the  students 
of  Air  Command  and  Staff  College  In  September  196 S.  In 
his  address  General  Carpenter  forcefully  emphasised  the 
general  Inadequacy  of  Air  Poroe  officers  in  the  field  of 
systems  analysis.  Moreover,  General  Carpenter  stressed 
that  Air  Force  officers  must  bscome  more  familiar  and 
active  In  this  field  In  order  to  present  the  Air  Force 
position  more  accurately.  He  further  emphasized  the 
need  for  competent  military  to  gsln  acceptance  by  the 
strong  analytical  element  within  the  Defense  Department. 


Ill 


Th«  basle  objective  Of  this  paper  will  be  satisfied 
If,  even  in  a  Mall  »«y*  It  lsproves  the  military 
onager's  understanding  and  ability  to  apply  affielantly 
hit  resources  to  systsss  analysis  and  hit  deeislon- 
aaking  needs. 

Tha  wrltsr  would  Ilka  to  erprass  hi a  alnoare 
appreciation  for  tha  efforts  devoted  by  W  Col  Uwrance 
B.  Pota  and  Lt  Col  John  J.  Boyna  toward  the  completion 
of  this  thesis.  Tha  guidance  provided  by  these 
officers  and  tha  patlenoe  and  assistance  of  tny  dear 
wife  ware  Instrumental  in  tha  successful  completion  of 
this  project  and  I  as  dssply  gratsful. 
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CHAPTER  I 


INTRODUCTION 

The  problem®  of  military  ehoioe  In  the  fifties  were 
(or  were  thought  to  be)  simpler  than  those  with  which 
we  shall  deal  in  the  future.  In  the  peat,  little  use 
was  made  of  any  systematic  method  in  decision-making. 
Acceptable  results  using  rationalizing  choice  were 
relatively  easy  to  come  by~onoe  ever-present  bureau¬ 
cratic  obstacles  were  overcome.*  Decisions  based 
totally  on  rationalisation  and  intuitive  Judgment  ere 
no  lonecer  acceptable.  Modern  decision  -makers  must 
avoid  the  temotation  of  single  Judgment  and  use  the 
systematic  methods  of  analysis  now  available  to  them. 

The  function  of  the  new  analytical  technique  com¬ 
monly  referred  to  as  system  analysis  has  been  to  provide 
decision-chokers  with  a  ayetemntie  method  by  which  they 
may  determine  relevant  alternatives  or  choice;;  in 
solving  problems.  This  methodology  does  nor  >uov5.dr>  the 
most  correct  choice  in  any  sequence  or  priority,  but 
rather  it  attempt*  to  eliminate  the  undesirable  courwee 
of  action  and  wasteful  choices.  In  using  this  method¬ 
ology  the  decision-maker  must  recovnlr®  the  essential 


characteristics  and  not  exaggerate  lte  usefulness  .  .  . 

2 

actual  or  potential. 

Hieing  costs,  r'phletication  of  systems,  and 

increasing  unoertaintiee  doe*  not  allow  high  level 

decision-makers  the  luxury  of  gross  errors  of  Judgment, 

eopeolally  in  the  area  of  treating  uncertainty.  The 

use  of  system  analysis  provides  a  metnod  for  treating 

uncertainty  and  at  the  same  time  providing  the  deolslon 

with  efficient  alternatives. 

The  elimination  of  gross  inefficiencies 
permits  us  to  specify  more  precisely  major 
uncertainties.  This  la  important  in  that  in 
some  ways  these  uncertainties  are  increasing 
rather  than  receding,  particularly  those 
relating  to  objectives  or  measures  of 

effectiveness. 3 

An  illustration  of  this  type  of  uncertainty  would  be 
the  Inability  of  the  Department  of  Defense  In  peacetime 
to  measure  the  Derfontanoe  of  many  of  our  defense 
systems  against  our  enemy's  offensive  threat. 

Tho  crucial  ohoioas  faoing  decision-makers,  military 
and  civilian  at  all  levels,  warrants  a  ootacrehenalve 
understanding  of  all  the  possible  methods  of  analysis 
available  to  them  to  aid  in  making  proper  choices, 
similarly,  the  d  eo  Is  ton-mo  ker  suit  choose  his  method  of 
analysis  based  on  his  Judgment  ss  to  how  rauoh  of  his 
resources  he  should  expend  on  the  analysis  effort. 

Prior  to  embarking  on  any  analysis  effort  a  critical 


diagnosis  Is  necessary.  "Accurate  diagnosis  lo  the 

essential  first  phase  of  sound  dsolsion-maklng.  Unless 

the  initial  diagnosis  is  oorreot,  all  subsequent  planning 
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sill  be  futile."  The  amazing  sueoess  of  American 
industry  during  the  last  half-century  with  scientific 
management  has  led  most  modem  managers  to  regard 
intuition  as  a  last  resort. ^  Mr.  Alfred  P.  Sloan,  Jr., 
in  commenting  on  the  phenomenal  success  of  General 
Motors  Corporation,  which  he  heeded  for  so  many  years, 
said,  "Pew  people  aro  willing  to  go  to  the  length  we  do 
to  get  all  the  facts  possible  and  look  at  a  problem  from 
all  angles  befors  making  a  deelalon."^ 

Many  times,  as  in  the  case  of  defense  systems,  we 
are  confronted  with  a  sltuatlcn  that  is  oomplex,  orln- 
cipnlly  because  so  many  different  things  need  improve¬ 
ment.  Undoubtedly,  some  connections  exist  between 
problems  that  are  very  similar  and  we  will  sometimes 
yield  to  one  ir,  ty  doing  so,  we  can  improve  perform¬ 
ance  with  respect  to  the  others.  At  what  point  do  we 
stop  trading?  If  we  are  uncertain  about  the  ansv  or,  It 
must  mean  that  performance  is  in  a  range  in  which  v»o  do 
not;  feel  strongly  about  minor  differences.  This  is 
another  way  of  saying  that  this  problem  or  aspect  of  a 
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larger  encompassing  one  is  no  longer  important.  fhi* 
is  what  the  writer  contends  is  a  critical  point  in  the 
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diagnosis  period  for  a  manager.  This  is  the  point  where 
he  will  make  a  deolslon  at  to  how  much*  if  any,  of  hie 
resources  he  should  expend  in  analysing  this  problem. 

Stei aamt  ?r  YnHv* 

This  thesis  will  examine  some  of  the  feotore  that 
decision-makers  must  consider  in  making  a  decision  on 
the  type  and  extent  of  analysis  to  bs  performed. 

The  main  objective  of  this  thesis  IS  to  provide  an 
Insight  Into  a  systematic  methodology  for  selecting  the 
metliod  of  analysis  applloable  to  a  given  situation  and 
for  determining  how  much  analysis  resources  should  be 
expended. 

The  soeclflo  objectives  arsi 

1.  To  examine  the  basic  history  and  theory  of 
system  analysis. 

2,  To  examine  two  typos  of  systsa  analysis  with  an 

example  of  each. 

3*  To  examine  the  application  and  problems 
associated  with  systems  analysis. 

4.  To  examine  specific  factors  deoiQion-wakers  must 
consider  In  cJjooslng  the  method  and  extent.  Provide 
through  application  one  method  for  selection  of  type  and 
extent  of  analysis. 
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Limitation*  and  Aasumptlons 

This  study  doe*  not  eonsider  complicated  or  sophis¬ 
ticated  mathematic  example*  or  specific  mathematical 
areas  of  analysis.  It  will  <!eal  with  the  general 
problem  faoed  by  a  manager  assuming  the  detailed  data 
would  normally  be  prepared  by  analysts. 

It  Is  assumed  that  decision-makers  will  expend 
their  resources  only  after  careful  examination  of  the 
problem  and  careful  choice  of  analysis  has  been  made. 

If  decision-makers  fail  to  examine  all  necessary 
factors  Involved  with  selecting  their  method  and 
expenditure  of  resources,  this  thesis  will  provide 
little  service.  Finally,  it  Is  assumed  that  decision¬ 
makers  will  always  have  some  constraints  In  the  form  of 
scarce  resource*  whloh  will  necessitate  a  critical 
diagnosis  of  their  problem  and  the  manner  and  depth  of 
analysis  needed  ;o  produce  relevant  alternative* . 

Overview 

Caapter  One  ^resented  the  problem  and  objective  of 
this  thesis. 

Chanter  Two  <111  describe  the  t beery  of  syeta", 
analysis,  the  need  for  system  analysis,  and  some  'limita¬ 
tions  to  system  analysis. 

Chapter  Three  will  or**nr?nt  two  types  of  ays tom 


Analysis-- cost-effeotlveness  analysis  and  payoff  tables* 
Chapter  Four  will  demonstrate  application  and 
problems  associated  with  system  analysis. 

Chapter  Five  will  show  a  method  that  a  decision¬ 
maker  can  use  in  ohooelng  the  aithod  and  extent  of 
amlyels  effort. 


CHAPTER  II 


SYSTEM  ANALYSIS 

Our  modern  world  and  particularly  the  United  States 
finds  itself  at  a  dangerous  crossroads  In  the  race  for 
technological  suoremaoy.  If  we  fall  to  tnVa  the  right 
path  to  terhnologioal  supremacy,  It  can  be  disastrous 
to  our  way  of  life;  but  noossc  will  provide  the  world 
and  our  nation  the  security  and  progress  we  so  desper¬ 
ately  seek.  Rising  uncertainties  and  ever  increasing 
sophistication  in  the  state  of  the  art  has  provided 
this  crossroad— >»  crossroad  of  choice.  So  longer  can 
modem  -r.iiitnry  leolsion-wakera  rely  on  intuitive 
Judgments  alone.  The  experience*  of  the  pant  no  longer 
lend  themselves  co  the  complexities  and  uncertainties 
associated  with  the  problem  of  choice  in  the  present 
age.  In  response  to  this  problem  of  choice,  a  system¬ 
atic  method  of  Approaching  problems  and  selecting  from 
among  alternatives  has  evolved.  This  methodology  using 
both  date  acquired  frorr:  sclent  1  fie  methods  and  intuitive 
reasoning  is  called  system  analysis. 

The  use  of  systems  analysis  in  decision-making 
requires  the  expenditure  of  varying  amounts  of  the  -»«ers 
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resources.  The  purpose  of  this  ohapter  le  to  provide 
useful,  general  information  on  system  analysis  and  to 
examine  the  systematic  methodology  used  In  auoeeesful 
Analysis  efforts.  Careful  consideration  of  the  con¬ 
cent*  presented  in  this  chaster  will  provide  a  better 
framework  for  those  contemplating  use  of  system 
analysis  and  enable  them  to  expend  their  resources  in 
these  efforts  more  efficiently. 

gtefeJLIt 

System  analysis  Is  still  largely  an  art  and  not  a 
science.1  It  is  a  way  of  thinking— an  approach  to  the 
modem  problone  of  choice.  System  analysis  la  net  a 
true  scientific  approach  beoauee  ell  of  Its  predictions 
and  alternatives  cannot  be  verified.  E.  S.  iiuade  says 
that* 

The  phrase  "  systems  analysis"  refers  to 
formal  inquiries  Intended  to  advise  a  deci¬ 
sion-maker  on  the  policy  choices  Involved  In 
such  matters  as  weapon  development  force 
nocture  design ,  or  the  determination  of 
strategic  objectives.2 

A  form  of  systems  analysis  was  first  used  during 
world  Via r  II  when  it  became  apparent  to  military  men 
that  many  of  the  systems  being  developed  Involved  tech¬ 
nical  know-how  whloh  was  foreign  to  past  military 
experience  or  training.^  Radar  was  r  good  example  of  « 
new  concept  that  could  not  be  exploited  by  allltary 
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planner*  alone.  To  meet  this  challenge  a  "scientific" 
approach  was  Instituted  combining  the  talents  of  many 
professions  such  as  physiolsts,  mat  hematic  Ians ,  And 
similar  highly  specialized  area*.  Initially,  this 
early  form  of  analysis  was  called  '"operations  research. 
Through  time  the  term  has  evolved  to  the  term  "ay stems 
analysis."  The  change  from  "operations  researoh'*  to 
"systems  analysis*  hat  resulted  primarily  from  the 
postwar  military  studies  which  were  mainly  concerned 
with  broad,  ooraplex  problems  and  weapon  systems.  The 
use  of  the  analysis  prooess  in  evaluoting  and  ohoosing 
among  systems  quite  naturally  came  to  be  known  as 

h 

"system*  analysis.” 

Today,  the  major  difference  between  operations 
researoh  and  systems  analysis  lies  in  emphasis.  While 
both  deal  with  mathematical  models  end  economic  optimi¬ 
zation  techniques,  "systems  analyalB  deale  with  con¬ 
ceptual  problems.""*  Those  where  "the  problem  Hen  In 
deoidlng  what  ought  to  be  done  .  .  .  not  simoly  ho:;  to 
do  lt."^  Here  lies  the  point  of  emphasis  between  opera 
tlorwj  research  and  system  analysis.  With  operations 
researoh  the  emphasis  le  on  how  to  get  the  ^ost  out  of 
what  we  have,  the  m&xlmi'/atlon  of  efficiency  in  systems 
or  equipment  already  developed.  On  the  other  hand, 
when  healing  with  systems  analysis  we  tend  to  thlrf;  in 
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terms  of  "high  level,"  "broad,"  "long-range , "  "oholoe- 

of -objectives'*  which  normally  are  associated  with 

sophisticated,  present  and  future  naada.  Duo  to  Its 

nature  systems  analysis  is  normally  assooiatad  with 

national  objectives.  While  the  consideration  of 

optimization,  that  of  maximizing  achievement  of  objeo- 

tives  and  minimizing  cost,  is  pressnt,  it  Is  only  n 

stage  of  the  overall  system  analysis. 

In  short,  the  analysis  of  weapons  or  strate¬ 
gies  for  future  wars  presents  s  new  kind  of 
problem,  essentially  different  from  any  treated 
by  operations  research  in  World  War  II,  or  even 
the  Korean  War.  The  conditions  of  research  era 
different.  Thera  is  usually  more  timet  there 
are  large  computational  facilities t  there  is  a 
great  deal  of  peacetime  data  available,  but 
virtually  none  of  the  desired  operational 
information.? 

One  of  the  strong  points  of  system  analysis  lies  in 
the  systematic  methodology  used.  The  process  la  an 
Iterative  one,  a  oyole  starting  with  problem  formula¬ 
tion,  search,  motiel  building,  end  interpretation.  It 
la  a  dloolpllno  of  weighing  results,  questioning  assump¬ 
tions,  Investigating  new  alternatives,  and  reformulation 
In  order  to  obtain  the  spectrum  of  alternatives  believed 
to  bo  sufficient  to  produo©  all  relevant  alternatives, 
i he  analyst  Initially  enters  the  oyole  with  his  problem 
and  this  le  called  the  formulation  stage.  He  then 
moves  to  the  aearoh  stage,  then  to  the  exploration 
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stage,  and  finally  to  the  interpretation  stage.  When 
discussing  the  oyelioAl  movement  of  the  Analysis 
activities.  It  is  important  to  note  that  the  analyst, 
through  the  use  of  a  systematic  approach,  hae  the 
option  to  stop  at  any  point  and  retrace  or  alter  any 
input  to  the  analysis  effort.  The  analyst  may  complete 
the  cycle  and  get  results  that  don’t  agree  with  his 
intuitive  Judgment.  Some  o'“  ths  initial  data  may  or 
may  not  be  verified.  This  is  the  nature  of  the  method, 
in  that  much  of  the  work  done  in  systems  analysis  deals 
with  future  requirements  and  uncertainty.  It  is  this 
complementing  notion  of  using  data  from  both  intuitive 
reasoning  and  scientific  methods  that  eventually  improves 
the  validity  of  the  resulting  choice  of  alternatives. 

Thus  we  oan  say  that  systems  analysis  is  n  logical  and 
continuing  prooeis. 

It  la  a  cycle  of  definition  of  objectives, 
design  or  alternative  systems  to  aohieve  those 
objectives,  evaluation  of  the  alternatives  in 
terms  of  their  effectiveness  and  costs,  a 
questioning  of  the  objectives  and  a  question¬ 
ing  of  the  other  assumptions  underlying  the 
analysis,  the  opening  of  new  alternatives, 
the  establishment  of  new  objectives. 

When  dealing  with  broad  national  objectives,  the 

analyst  often  find®  It  difficult  to  start  his  analysis 

efforts.  The  first  Dhoso,  that  of  problem  formulation 

and  defining  objectives,  can  be  ortromely  difficult  duo 

11 


to  vague  or  non-existent  statements  of  national  objec¬ 
tives.  This  Initial  phase  nay  be  shrouded  under  n 
blanket  of  secrecy  that  oan  only  allow  for  Intermediate 
objectives  and  criteria  that  approximate  what  the 

o 

nnaljrst  Judges  to  be  the  higher  level  of  objeotlvea. 
tfhile  working  in  the  formulation  stage,  the  analyst  oan 
often  uncover  objectives  thfit  were  overlooked  or 
eliminate  some  that  were  previously  aooepted.  It  Is 
very  Important  tint  correct  objeotlvea  be  established. 
The  wrong  Initial  oholoe  of  objectives  means  that  the 
analyst  my  not  be  working  on  the  oorreot  problem.10 
The  problem  of  using  Incorrect  objectives  onn  stem  from 
another  source |  that  of  using  persona  of  such  wide 
variation  in  professional  background  as  to  cause  mlc- 
lnteroretntlon  o'  problem  and  objeotlvea.  It  appears 
most  Important,  then,  that  all  involved  have  e  concrete 
hypothesis  from  which  to  work.  The  Idea  is  to  make 
clear  the  objectives  and  atruoture  of  the  analysis  to 
all  en^ged  in  the  analysis  effort.11 

The  second  phase  of  the  analysis  oyols  is  the 

a  oar  oh  phase.  It  le  hare  that  tha  analysts  are  probing 

facts  on  which  to  base  the  analysis.  It  Is  Important 

to  roooruiimc  that  the  analyst  oust  handle  the  faote  and 

quantitative  data  honestly— with  no  blaw  end  Insure  that 

alternatives  are  not  arbitrarily  suppressed.12  Value 

12 
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Judgments  must  enter  into  the  analysis  effort,  but  It 
is  expected  that  the  analyst  will  identify  these  Judg¬ 
ments  to  the  deolsion-raaker.  The  area  of  oost  is 
naturally  considered,  but  only  as  a  part  of  the  study 
of  resources  versus  objectives. 

The  third  stage  of  analysis  is  the  exploration 
stage.  It  is  hero  that  many  analyses  fail  due  to 
Improper  model  construction.  At  this  stage,  models  are 
constructed  and  mathematical  computations,  comparisons, 
and  ooot-effeotlveneas  applied  to  the  models*  In 
systems  analysis  It  is  important  to  remember  that  the 
mathematician  suet  deal  with  the  real  world.  It  la  not 
unoommon  for  mathematician#  to  become  slanted  toward 
the  computation  of  the  analysis  model  and  move  away 
from  the  original  question#  of  tho  study. 

The  last  stage  of  the  normal  analysis  Is  the 
Interpretation  stage.  It  is  here  that  all  the  non- 
quantifiable  data,  uncertainties,  and  oontlngenolee  are 
considered  in  relation  to  the  solution  derived  from  the 
model.  At  this  point  conclusions  are  drawn.  It  la 
possible  that  the  final  results  are  not  satisfactory  to 
the  analyst  and  he  goes  hack  and  rework#  through  ell  or 
part  of  the  process.  When  he  presents  the  conclusions 
to  the  <ieol#ion~ra«ker ,  he  smart  also  present  what  ho 
thinks  the  aolistion  Implies.  It  must  bo  remesiberod 
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that  the  modal  Is  only  an  Indicator,  not  a  Judge.*1* 

The  analyst  at  this  point  Is  not  making  deolsions, 
rather  he  is  helping  the  de© Is Ion-maker  sake  the  proper 
ahoioes.1^  He  Is  aseieting  dec le Ion-makers  In  the 
expend  It  ire  of  their  nation's  or  oeapany'a  rital 
resources  based  on  oonsldered  Judgment  of  what  the 
analysis  Indicates  to  be  the  most  oorreot  choice  of 
alternatives. 

Decision-making  In  Its  simplest  form  can  be  defined 
as  the  selection  of  an  alternative  or  alternatives  frees 
one  or  several  possible  alternatives.  It  is  a  method 
for  determining  the  ultimate  course  of  aotlon.  System 
analysis  is  much  the  same,  but  there  is  a  significant 
difference.  In  system  Analysis  the  scope  is  usually  of 
a  broad  nature  and  the  discipline  is  systematic.  The 
complexity  of  multiple  objectives,  uncertainty,  and 
constraints  In  the  form  xf  resources,  requires  a  method¬ 
ology  that  treats  the  whole  system.  Its  purpose  is  to 
formulate  and  reformulate  every  element  to  Insure  that, 
the  resulting  alternatives  represent  the  bent  ooastble 
choices  to  the  decision-maker  as  he  goes  about  the  task 
of  clodding  between  these  choices  and  expending  his 
resources. 
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The  Defense  Department  today  1*  the  largest  single 
business  In  America.  It  Is  the  heart  of  a  complex. 
Interdependent  team,  widely  diversified  yet  mutually 
oriented.  This  Department  is  responsible  for  spending 
nearly  10  per  oent  of  the  national  Income  of  this 
country.  It  employs  3.7  million  people  directly  in  end 
out  of  uniform  and  millions  more  Indirectly  In  every 
nflpeot  of  our  economic  life.*^ 

Control  of  the  complex  Defense  organ lxat Ion  and 
efficient  direction  of  Its  power  and  resources  toward 
achievement  of  i«*  mission  of  national  security 
requires  more  than  intuitive  and  parochial  Judgments. 

It  requires  systematic  approach  ©t  all  levels.  The 
method  for  gathering,  analysing,  and  presenting  the 
data  necessary  for  decision-making  has,  due  largely  to 
the  extensive  and  Imaginative  use  of  automatic  data 
computing  by  the  military,  advanced  to  a  point  where 
centralised  decision-making  is  both  efficient  and 
effective. This  unity  end  commonality  of  systems 
eliminates  soms  of  the  major  deficiencies  of  oast 
decades  when  dealing  with  national  security.  The  peat 
systems  were  prone  to  independent  oroc ureiticnt  policies, 
lnterservloe  rivalries,  and  great  redundancies  in  some 
typos  of  capabilities  and  serious  shortages  In  others. 
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Aooordlnft  to  Alain  Knthevsn,  Deputy  Assistant  Secretary 
of  Defense  for  Syataoe  Analysis,  during  the  Elsenhower 
era  there  was  almost  complete  separation  between 
planning  and  dedalon-maklng  on  systems  end  loro ea  on 
one  hand,  end  budgeting  on  the  other.  The  services 
made  decision*  on  national  eeourlty  baaed  on  their 
eatluinteu.  Coata  were  not  Introduced  systematically  to 
teat  the  feasibility  of  either  the  program  or  the 
allocution.  The  full-time  or  phased  ooata  of  the 
propoaed  force*  sere  not  presented  to  the  Secretary  of 
Defense.  Because,  in  many  instances,  the  coata  were 

aoall  in  the  early  year*,  many  program*  were  ntnrted 

1 ft 

that  could  not  bo  completed  under  existing  budgets. 
System*  analysis  did  not  resolve  thle  problem  but 
Secretary  of  Defines  MoNamnre,  using  system*  analysis* 
a*  a  tool,  did.  Mr.  Janies  R.  Sohleelnger  puts  It  thin 
way* 

The  function  of  the  new  analytical  tech¬ 
nique*  ha*  not  been  to  give  ue  the  correct 
choice  In  making  military  decision,  but 
rather  to  eliminate  now®  very  bad  nnd  waste¬ 
ful  choice*.  In  our  cnthusleem  regarding 
analysis,  we  nhould  not  exaggerate  lte 
accomplishments  actual  or  potential.1? 


At  the  present  time  system*  analyole  Is  po»*ibly 


the  best  managerial  tool  available,  but  the  future  may 
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find  it  Inadequate.  As  the  domain  of  systematic 
quantitative  analysis  inorease* ,  and  as  the  irrational 
vasts  recedes,  our  attention  will  turn  to  t’  ose  aspects 
of  national  security  in  which  quantitative  analysis 

cannot  provide  choices i  the  problems  of  objectives, 

20 

uncertainties,  and  strategic  choice. 

One  of  the  major  limitations  in  using  systems 
analysis  continues  to  be  in  the  area  of  treating 
uncertainty.  There  are  several  kinds  of  uncertainty* 
the  uncertainty  In  planning  factors  |  the  enemy  and  hie 
reaotlonsi  the  strategic  context  such  as  "Who  will  be 
our  enemies,  or  who  will  be  our  allies?, "  "Will  there 
be  a  war  during  the  period  covered  by  our  analysis ?!*' 
technological  uncertainty!  and  lastly,  statistical 
uncertainty.21  Jf  we  look  only  st  the  statistical 
uncertainty,  we  :rind  that  It  le  obvious  that  using  oost 
data  in  a  cost-effectiveness  analysis  of  a  weapon 
system  is  feasible  but  how  do  we  measure  the  effective¬ 
ness  from  a  military  standpoint?  Of.  E.  S.  Quads  infers 
that  there  is  a  way  to  measure  military  effectiveness? 

Having  agreed  upon  the  objectives  and 
determined  e  way  to  measure  ths  military 
effectiveness  of  the  system,  the  analysis 
becomes  a  eost/effeotlveness  analysis.2" 

The  writer  feels  that  there  ie  one  major  premise  of 

systems  analysis  that  in  most  often  overlooked.  That 
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premise  is  xnai  analysis  is  stm  an  arc  ratner  xnmxi  u 
science.  It  Is  dene  In  sene  cases  using  data  thought  to 
be  right  and  possible,  but  with  data  no  one  can  verify 
and  that  can’t  bo  justified.  The  user  must  accept  as 
Inputs  many  relatively  intangible  footers  which  are 
derived  from  huaan  judgment  and  present  answers  whloh 
are  then  used  as  material  for  other  judgments*  This 
judgment  is  supplemented  by  lnduotive  and  numerical 

reasoning,  where  possible,  but  it  judgment  nons-the- 

,  23 

less. 

In  summary,  "the  systems  analyst  Is  not  restricted 
to  the  systems  he  starts  to  compare.  The  most  valuable 
function  of  systems  analysis  is  oftsn  the  stimulus  it 
gives  to  the  innovation  of  better  system*.  Systems 
analysis  is  necensary  in  modem  notional  security 
deololon-waklng.  It  is  fair  to  say  that  those  who  are 
most  critical  of  its  use  in  solving  the  eomplsx  problem 
of  national  security  have  not  as  yst  provided  any 
alternative  method. 
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CHAPTER  III 


METHOEG  OF  ANALYSIS 

In  the  preoedlng  captor,  the  term  "system  analysis" 
wan  defined  in  its  broadest  sense  relative  to  the 
deoiaion-malclmr  process..  TV  .a  writer  will  now  examine 
in  more  specific  detail  two  of  a  number  of  precise 
methods  of  analysis  that  a  decision-maker  may  choose 
between.  While  systems  analysis  is  normally  associated 
with  the  Department  of  Defense,  American  industry  is 
adapting  this  methodology  on  an  increasing  scale.  The 
two  types  of  analysis  presented  in  this  chapter  are 
representative  of  analysis  efforts  employed  by  the 
Department  of  Defense  and  Industry.  The  key  to  success 
in  decision-making  does  not  of  necessity  lie  only  in 
the  analysis  Itself,  but  rather  the  deolsion-raaker  must 
assure  that  the  proper  type  of  analysis  has  been 
selected  and  available  resources  are  efficiently 
expended.  Analysis  like  economics  involves  the  alloca¬ 
tion  of  scarce  resources. 

Resource  limitations  are  our  starting  point 
because  in  nil  problems  of  choice  we  strive 
to  cret  the  most  out  of  what  vre  hove.  To  put 
It  another  way,  we  try  to  use  the  resources 
that  are  available  to  us  so  as  to  maxim! re 
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what  economists  oall  "utility.  •  Resources 
nre  always  Halted  In  comparison  with  our 
wants*  always  constraining  our  action.1 

It  Is  this  oodsm  theory  of  utility*  or  marginal 

analysis*  and  mors  speolfloally  "oost-offsotivsnsss" 

that  will  be  treated  first. 


x-i  m  >  li,  :*i 


Onos  the  dsoislso Hasher  has  assured  himself  that 
his  problso  is  quantifiable— that  is*  haring  the  capa¬ 
bility  to  asasure  both  the  cost  and  the  effectiveness— 
he  then  proceeds  to  swine  it*  to  establish  hie 
objectives  and  his  orlterlen.  It  is  at  this  point  that 
common  sense  tells  ths  decision-maker  that  without  sooe 
constraints  on  ths  lsrvel  af  effeotlvsneas  or  total  oost* 
the  ratio  may  develop  extreme  points  of  effectiveness  or 
oost.  It  becomes  apparent  that  It  is  foolhardy  for  ths 
deolsion-maker  to  work  at  olthor  extreme*  for  as  in  the 
oaae  of  defense  spending,  e  deolslen  based  on  oost 
alone  might  prove  to  be  an  inexpensive  may  to  Invite 
and  lose  a  war.  ^  As  hr.  Xlteh  stated!  "Resources  are 
always  limited  in  coarparieon  to  our  wants*  always  oon- 

K 

straining  our  actions." 

The  writer  aooepts  this  oondltlon  and  presrul gates 
the  position  thet  with  budget  limitations*  as  la  ths 
case  of  defense  spending  and  the  depends  of  national 


security,  the  use  of  ceet-effeotlvsneee  analysis  is  a 
valuable  decision-making  tool*  Having  established  tha 
faot  that  the  rational  decision-maker  will  normally 
avoid  the  extremes  of  cost  versus  effectiveness,  we 
shall  now  look  at  two  examples  of  how  this  type  of 
analysis  oan  assist  in  determining  the  beet  ohoiee  of 
alternatives.  Zt  should  bo  pointed  out  that  these  ere 
over-simplified  examples  Intended  only  to  demonstrate 
the  technique  Involved .  ^ 

Type  I.  The  problem  is  to  maximise  the  number  of 
target e  destroyed  with  a  given  budget  of  XX  dollars. 

The  alternatives  for  accomplishing  this  task  may  bet 

1.  Use  all  type  B  (bomber). 

2.  Use  all  type  M  (missile). 

t 

3.  Use  a  combination  of  type  B  and  type  M. 

Figure  1  deplots  hsw  many  bombers  and  missiles  that 

oan  be  bought  with  XX  dollars  (it  assumes  that  the  ooet 
of  each  is  the  same).  The  range  of  ohoiee  is  from  all¬ 
bomber  fore*  of  150  B's  to  all-mlseile  force  of  300  w*su 
The  "exchange  curve"  (straight  line  A-B)  gives  the 
comparison  line  for  the  various  combinations  of  bombers 
or  mlssllss  that  oan  be  purchased  with  the  fixed  budget 
of  XX  dollars.  The  problem  is  now  to  determine  the 
optimal  mix  of  bombers  and  missiles  in  order  to  maximise 
the  targets  deetrcjred.  '7 
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B 

( Bombers ) 


(B) 


FIGURE  !• 

Figure  7  deplote  an  assumption  of  the  target 
lsoqxmnte  possible  and  the  various  combinations  of 
bombers  end  rnlsellea  and  their  target  kill  potential. 

Th©  method  of  determining  how  these  Isoquants  curves  are 
actually  derived  Is  quite  complicated  and  beyond  the 
scope  of  this  thesis.  An  appreciation  of  how  these 
curves  are  used  in  oost/effeotlveness  studies  Is  not 
conditioned  upon  an  understanding  of  how  they  are 
constructed . 

In  Figure  7  the  point  within  the  small  clrole 
(Point  P)  rapresents  the  optimal  six  of  bombers  and 

HO  missiles  to  destroy  200  targets.  No  further 


•This  model  obtained  from  "The  Cost  Effectiveness 
Method,"  R^eearoh  Study,  Air  University,  1Q64. 
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Fixed  Budget  (Bxohsngs  Curve) 


FIGURE  2* 

substitution  of  B  for  M  or  M  for  B  would  Increase  the 
total  possible  number  of  targets  that  could  be 
destroyed.^  In  short,  on  the  basis  of  a  fixed  budget, 
this  point  "P"  gives  the  best  mix  of  bombers  and 
missiles  with  which  the  maximum  number  cf  targets  would 
be  destroyed.  Having  seen  the  application  of  economies 
to  maximise  the  target  kill  with  a  fixed  budget,  we  will 
now  turn  to  the  problem  of  minimising  oost  with  a  fixed 
or  specified  level  of  effectiveness. 

Type  II.  This  problem  differs  from  Typs  I  in  that 
we  are  given  a  fixed  level  of  target  kills  required  and 
we  are  to  minimize  the  cost.  Onoe  more  the  modal  will 
be  simplified  to  insure  complete  understanding  of  the 

•This  model  obtained  from  "The  Cost  Effectiveness 
Method"  Research  Study,  Air  University,  1964. 
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technique.  A*  In  Type  I,  we  find  three  alternatives! 

1.  Use  ell  bomber*. 

2.  Use  ell  missiles. 

3.  Uee  a  nix  of  bombers  end  missiles. 


Missiles 

FIGURE  3* 

In  this  problem  we  here  e  fixed  level  of  effective¬ 
ness  of  200  target*.  We  must  determine  et  whet  point  on 
the  target  isoquant  we  minimise  the  ooat  by  plotting 
the  alternative*  shown  above. 

We  find  that  the  exchange  curve  which  1*  tangent  to 
the  target  isoquant  et  Point  P  I*  the  same  as  Point  P  In 
Type  I,  that  1*  the  ease  aix  of  boaber*  and  missiles 
both  most  efficient  and  minimal  oost  wise.^ 

♦Model  obtained  from  “The  Cost  Bf feotlveness  Method 
Research  Study*  Air  University*  1964. 
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FIGURE  4* 


It  1*  Important  to  not®  that  the  budget  line  and 
the  target  assigned  Are  provided  the  analyst  as  a 
result  of  separate  or  post  analysis.  Reoognlse  that 
the  X,  Y,  7,  would  not  be  truly  straight  lines,  but 
would  be  curved  because  of  the  varying  costs  of  large 
vereus  email  production  runs  of  either  bombers  or 
missiles,  for  purposes  of  simplifying  the  Illustration, 
they  are  shown  as  straight  lines. 

The  writer  has  attempted  to  show  the  very  basic 
formulation  of  oost /effectiveness  through  the  use  of 
economic  models  (Figures  1-4).  The  proper  use  of  data? 
derived  from  such  a  model  will  be  very  helpful  to  the 
analyst  and  ultimately  the  deolslon-maker,  but  there 

*Model  obtained  from  "The  Cost  Effectiveness  Method,” 
Research  Study,  Air  University,  1964. 
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are  some  consideration*  that  euet  be  remembered* 

1.  While  ooet  estimates  are  basically  easy  to 
determine,  the  estimate  on  levels  of  effectiveness  are 
often  only  educated  guesses. 

2.  The  faator  of  uncertainty  and  changing 
technology. 

3.  Incompleteness— both  as  result  of  the  limita¬ 
tions  of  time  and  money  with  effeot  on  the  depth  of  the 
inquiry  and  the  exactness  of  data  inputs.10 

In  the  case  of  federal  expenditure  for  defense,  the 

use  of  cost  /effectiveness  analysis  Is  a  systematic 

rational  way  of  looking  at  a  problem  and  gives  at  least 

a  smaller  margin  of  error  than  th*  previous  preotloe  of 

"trade  off  and  bargaining  between  th#  servloe  for  funds. " 

The  following  is  an  appraisal  of  th#  value  of  this  type 

analysis  by  Robert  3.  McNamara* 

In  adding  to  a  dsfsnss  bud  gat  as  large  as  the 
one  ws  now  have,  ws  begin  to  encounter  the 
low  of  diminishing  returns,  where  eaoh  addi¬ 
tional  increment  of  resources  applied  produces 
a  smaller  increment  of  overall  dsfsnss  capabil¬ 
ity.  While  the  benefits  to  b*  gained  from  each 
additional  increment  cannot  be  measured  with 
precision,  careful  oost/effectlvenees  analysis 
onn  greatly  assist  in  eliminating  these  program 
proposals  which  clearly  oontrlbut#  little  mili¬ 
tary  wealth  In  relation  to  the  resource  expen¬ 
ditures  involved.  Ws  have  applied  this  prin¬ 
ciple  throughout  our  program  and  budget 
reviews.  ** 

The  decision  made  by  the  Department  of  Defense  oan 
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not  be  considered  rational  if  adequate  knowledge  of 

alternatives  in  terns  of  their  military  worth  are  not 

1? 

related  to  their  oost*  *  We  cannot  be  so  poor  as  to 
fall  to  pAy  the  necessary  prloe  for  national  security 
nor  rloh  enough  to  squander  our  resouroes  in  the  name 
of  national  security.*'*  The  value  of  oost/effeotlve- 
nee*  analysis  and  Its  economic  background  oannot  guide 
ua  to  a  total  solution,  except  in  a  very  formal  and 
empty  aenve.  However,  it  can  be  a  useful  guide  In 
examining  alternatives  and  making  Improvements.  We 
shall  now  examine  another  decision-making  tool  that  la 
found  more  In  the  business  world  than  the  government. 

A  method  of  analysis  which  is  less  complicated  than 
oost/effsctlveness  analysis  but  nevertheless  very  help¬ 
ful  In  decision-making  is  use  of  the  "Pay  Off  Table." 

This  method  of  analysis  has  been  developed  with  certain 
human  limitations  in  mind.  The  first  limitation  Is  that 
the  human  mind  does  not  function  well  when  dealing  with 
multi -dimensions,  with  handling  two  sides  of  a  question 
simultnneously.  The  aacond  limitation  Is  that 

•The  thoughts  and  models  on  the  subject  of  Pay  Off 
Tables  were  obtained  from  a  lecture  by  Dr.  Paul  A.  Vetter, 

"Declslon-^aklng,'*  to  the  students  of  Air  Command  and 
Staff  College  la  September  19o4. 
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frequently  "seat  of  thQ  pant*,"  Intuitive  Judgment  will 
not  seleot  the  best  oholoe  of  alternative*.  The  very 
heart  of  any  systematic  analysis  i*  the  adequate  aearoh 
for  and  examination  of  all  possible  alternatives  and 
the  proper  treatment  of  uncertainty.  What  often 
separates  the  good  from  the  poor  decision-maker  is  laok 
of  imagination  of  creativity  and  improper  treatment  of 
probability  and  unoertalnty. 

The  method  used  by  Julius  Caesar  to  devastate  hie 
foe*  was  to  divide  his  foes  into  segment*  and  oonquer 
them  individually,  then  regroup  his  force*.  The 
principle  of  dividing  and  oonQuerlng— the  breaking  down 
of  complex  problems  into  segmsnt*  and  applying  Judgment 
and  experience— is  the  foundation  of  the  "Pay  Off  Table.' 

To  describe  the  pay  off  table  and  its  possible  use 
by  decision-makers  the  writer  will  present  an  over¬ 
simplified  situation  and  model.  It  should  be  noted  that 
the  point*  are  over-simplified  purely  for  ease  in  under¬ 
standing  by  the  reader  and  does  not  oonstitute  any 
Inherent  weakness  in  the  method.  The  reader  should 
assume  that  he  is  acting  in  the  role  of  a  company  which 
produces  an  accepted  type  of  consumer  goods.  The 
research  division  of  the  company  has  proposed  a  new 
product  to  complement  its  existing  produet  line.  As  hsad 
of  the  company  you  feel  the  product  has  possibilities 
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and  decide  to  sake  a  decision  on  whether  to  place  it  on 
the  market  or  pass  it  by.  Based  on  the  depth  of  study 
required  and  available  data  and  other  resources,  it  is 
decided  to  use  the  "Pay  Off  Table"  method  to  analyse  the 
situation. 

In  dealing  with  the  "pay  off  table"  there  are  three 
major  aepeots  of  consideration! 

1.  The  monetary  aspaot— an  analysis  of  the  expense 
involved  and  the  expected  revenue. 

2.  The  aspect  of  forecasting— -the  demand,  the 
uncertainty. 

3.  The  risk  aspect— how  much  is  to  be  gained  or 
lost  If  plaoed  on  the  market?  What  premium  would  the 
company  want  to  make  in  order  to  take  a  risk?  If  at 
this  point  an  Informal  decision  was  made  on  snap  Judg¬ 
ment,  the  melding  together  of  all  three  dimensions  of 
this  problem  oould  result  in  disaster. 

The  company  engineers  state  that  there  are  two 
processes  for  production  of  the  new  product  1 

Prooftgs  A 

1.  The  produot  will  be  made  on  a  simple  machine 
that  the  company  leases  for  $1,000  per  year. 

2.  The  variable  cost  per  unit  of  production  will  be 

M.00. 
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1.  The  product  will  be  mad*  using  a  highly  auto¬ 
mated  oomplox  piece  of  machinery  whloh  the  company  will 
lean*  for  25*000  per  year. 

2.  The  variable  coat  per  unit  of  production  will 

be  2.50. 

Kor  the  purpose  of  this  model*  assume  the  tradi¬ 
tional  nsarket  price  of  this  type  product  to  be  fixed  at 
21.50  per  unit.  The  model  (Plgure  5)  i»  on  over¬ 
simplified  example  of  the  teohnique  used  in  this  type 
analysis.  The  first  column*  for  example*  shows  only 
three  volumes  of  sales.  This  range  could  bo  varied  from 
zero  to  point*  in-between  those  given  or  above  the 
hlghent  shown.  The  alternatlvee  fer  the  company  have 
been  limited  to  three?  again*  others  could  be  considered. 


PAT  OFF  TABLE 
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10,000 

0 

♦4,000 
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♦1,500 

0 

1,000 

0 

-500 

-4,000 
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Ae  stated  previously,  this  netted  of  analysis  depends  on 
breaking  down  the  problem  and  solving  each  aspect 
separately. 

Talcing  the  first  aspect ,  "the  monetary  aspeot,"  we 
construct  the  table  (Figure  5).  In  entering  Information 
to  the  tablef  the  first  alternative  of  not  producing  the 
Item  would  have  us  place  zeros  by  all  sales  volumes  as 
we  didn't  make  any  money  and  we  didn't  lose  any.  Look¬ 
ing  at  alternative  "A"  with  a  fixed  coot  of  $1*000  per 
year  and  variable  cost  of  $1  per  unit*  we  find  that 
1,000  sales  at  $1.50  per  sale  we  would  lose  $500  ($2*000 
cost- >1,500  sales  revenue ) .  Using  the  same  cost  data 
with  5,000  sales*  ire  will  show  a  profit  of  $1,500 
($7, 500  sales-#, 000  cost).  And  finally,  using  the  same 
cost  data  with  10,000  sales,  ws  would  make  a  profit  of 
$4,000  ($15,000  sales- $11, 000  cost). 

Moving  to  the  last  alternative,  HB,A  with  a  fixed 
ooat  of  35.000  per  year  and  variable  cost  of  $.50  per 
unit,  we  again  enter  the  table  with  1,000  sales  at  $1.50 
per  sale.  At  1,000  sales  we  enter  a  loss  of  $4,000 
$5,500  oost-31,500  sales)*  with  5,000  sales  we  enter 
zero  or  break  even  ($7,500  cost,  $7,500  sales) t  and  at 

I 

10,000  salsa  we  show  n  profit  of  $5,000  ($75,000  salsa, 

$10,000  oost).  Thus  we  have  handled  separately  the 

1 

"monetary"  aspect  without  complicating  our  mental 
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process  with  consideration  of  the  next  aspect — that  of 
'*  forecast  ing." 

In  the  are*  of  "forecasting,"  the  first  considera¬ 
tion  must  be  the  oritioel  event — the  demand.  tfhat  ie 
going  to  be  the  demand  for  this  product?  We  are  now 
dealing  with  an  uncertainty.  The  queetiona  of  product 
appeal,  produot  quality  background  data,  and  finally, 
just  how  strong  do  we  think  the  market  will  be,  muat  be 
equally  considered.  It  ie  it  this  point  that  we  work 
with  getting  odds.  tfe  will  aay  that  the  odds  are  one  in 
two  that  we  will  sell  1,000  and  one  in  three  that  sales 
will  be  5,000,  and  one  in  six  that  they  will  be  10,000. 
These  odda  are  eur  language  for  expressing  a  Judgment  on 
stiles.  It  should  be  emphasised  that  a  single  point 
Judgment  should  not  be  u»ed—*ay  B50  sales,  with  a 
decision  based  on  this  figure.  A  forecast  Is  based  on 
alternatives— wiuh  different  likelihoods,  hence,  the 
Judgment  of  odds,  Treat  the  Judgment  on  the  odds  like 
a  lottery.  For  example,  you  held  70^  of  the  tickets  so 
you  know  there  are  30 i  against  you.  Similarly,  you  know 
that  If  there  are  ten  tiokete,  you  hold  1  through  7 j  if 
it  ie  f*,  9,  cr  10,  you  lose.  If  you  hold  R,  9,  or  10, 

70 <■  or  1-7  are  against  you.  Try  and  find  the  best  Judg¬ 
ment  on  your  odds.  Use  all  data  available  suoh  as 
reoordn  showing  sales  of  similar  products,  look  at  market 
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prospects,  look  for  different  or  paoullar  features  of 
the  propoead  new  product  that  may  modify  your  Judgment 
of  tho  odds.  It  amat  be  remembered  that  the  monetary 
aspect  must  not  be  a  faotor  in  developing  your  forecast 
or  odds. 

In  dealing  with  tha  risk  aspect,  which  ie  the  final 
aspect  prior  to  putting  the  problem  together,  the  writer 
will  attempt  to  simplify  the  problem.  There  are  many 
method*  for  establishing  risks  and  in  the  real  world 
this  would  bo  handled  either  by  use  of  utility  theories 
or  Judgments.  For  tho  purpose  of  this  model,  assure©  the 
amounts  of  money  Involved  are  not  aignifioent  to  our 
firm.  Jith  this  premia*  established,  the  writer  will 
assume  away  the  risk  aapeut  with  a  judgment.  Having 
dealt  with  the  three  dimensions  of  the  problems,  we  will 
now  put  the  problem  back  together. 

The  criterion  will  be  the  greatest  expected  monetary 
value  ( 7 )  of  alternatives  "AM  and  ’‘ft."  The  index  for 
the  actions  covsrc-id  might  be  the  nvernc’o  welrhod  by  tho 
likelihood  (odds)  thfit  it  will  oocur  detinnd  wise.  For 
example,  the  U‘-R'V  of  ”Af<  would  be* 

i/r  of  -  500  (-.5250)  Plus  „  ?'WV  (  +  #oi? ) 

t/l  of  ►  -1500  (+}')0vr>)  Plus 

1/6  of  +V1.000  (+66?) 
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The  EMV  of  "B"  would  be» 

1/2  of  -$4000  {-$2000)  Pint 

1/3  of  0  (0)  Plus  -  EMV  (-#1167) 

1/6  of  +$5000  (♦  $833) 


PAT  0FP  TABLE  AND  EMV 
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FIGURE  6 


In  this  case  we  would  ohooee  alternative  HA."  The 
&MV  of  +$917  le  an  Index  of  the  desirability.  The  larger 
the  number,  the  more  desirable.  Thus,  the  rational 
decision-maker  could  look  at  his  model  and  Its  results 
and  say  monetarily,  demand  and  risk  wise,  alternative 
"A"  looks  more  favorable.  A  side  effect  Is  the  estab¬ 
lishment  of  the  value  of  perfect  information.  The 
monetary  value  will  be  the  same  as  the  EMV  of  X  (If  each 
amount  used  was  perfeot,  veriflble  data). 

EMV  t0  ♦  $500  +  $833  ■  $1333 

minus  917  BMV  of  "A" 

$  kib  Value  of  perfeot 
Information 
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The  significance  of  the  lest  point  le  that  the  more 
you  think  you  know,  the  lees  you  will  pey  for  informa¬ 
tion.  If  the  monetary  consequence  were  ten  times*  you 
would  pey  ten  tiaee  more  for  Information. 


Sans&Mlsa. 

In  thle  chapter,  two  of  tho  many  type*  of  Analyeee 
have  been  demonstrated.  The  eeleotlon  wae  Intended  to 
show  one  method  used  primarily  by  the  Defense  Department 
and  one  found  popular  In  the  Industrial  community.  The 
value  of  using  these  and  similar  methods  of  analyeee  In 
dec ie lon-maklng  enn  be  stated  best  by  the  remarks  ef 
A.  C.  Enthovens 

We  muet  make  defense  planning  and  the  selec¬ 
tion  of  weapon!  systems  on  an  lntellact\ial 
rather  than  <«n  emotional  process.  To  do  this 
we  must  turn  our  attention  to  the  question  of 
what’s  rlghtt  not  who's  right.16 
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CHAPTER  IV 


APPLICATION  AND  PROBLEMS  ASSOCIATED 
WITH  SYSTEMS  ANALYSIS 

In  previous  chapters  cm  examination  hat  been  made 
of  the  need,  atruoture,  and  methodology  of  systems 
analysis.  An  under* tending  of  this  need  and  the  work¬ 
ings  of  system  analysis  Is  necessary  in  dlsousslng  how 
deoialon-fnakars  oan  select  from  among  these  systems  of 
choice.  The  purpose  of  this  ohapter  Is  to  analyse  some 
applications  of  systems  analysis  and  Illustrate  some  of 
the  limitations  and  problems  associated  with  Its  use. 

A  fundamental  background  of  the  subject  should  provide 
the  decision-maker  with  a  more  objective  view  of  the 
value,  limitations,  and  problems  associated  with 
systematic  analysis.  This  fundamental  background  is 
nloo  of  value  to  the  dsolslon-maker  In  choosing  a  method 
of  analysis,  the  subject  of  the  next  chapter. 

& SLSzatsa 

To  describe  actual  application  of  system  analysis 
the  writer  will  use  as  a  model  the  analysis  process  used 
In  the  selection  of  the  TFX  System.  The  decision  by 
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Secretary  of  Defence  McNamara  to  oheoee  General 
Dynamiee/Grun»nn  ae  the  eouroe  for  the  controversial 
TFX  system  saw  use  of  setae  analysis  principles  such  as 
cost-effcctlveness,  use  of  criterion  (structural  design 
commonality  for  bi-servioo  use),  and  comparison  of  data 
If  we  look  at  the  discussion  in  Chapter  II  dealing  with 
the  various  activities  in  analysis,  it  beoomes  apparent 
that  Secretary  HoNaittara  went  through  four  of  the  five 
major  stages— that  of  formulation,  search,  explanation, 
and  interpretation.  Some  might  feel  that  the  fifth 
stag©,  that  of  verification,  had  been  dealt  with  to 
some  degree. 1  The  writer  would  propound  that  most  of 
the  verification  prior  to  award  of  the  contract  appears 
to  have  been  based  on  prior  experience  and  contractor 
conducted  tests,  and  thus  not  entirely  complete.  By 
taking  eaoh  stage  separately  nnd  looking  at  the  basic 
steps  taken  by  the  Secretary  of  Defense,  we  can  gain  n 
better  understanding  of  his  approach  to  the  problem. 

The  first  stage,  that  of  formulation,  was  initiated 

with  the  decision  that  the  proposed  TFX  coincided  with 

Secretary  McNamara’s  idea  of  a  weapon  system  which  was 

required  to  operate  under  the  "controlled  response 

theory l.e.,  one  that  provided  options  on  utilisation 

choices  suoh  ns  all-out  nuclear  strategic  cnrmMllty 

2 

or  tactical  use  of  atomic  weapons.  This  decision  l«d 


to  a  second,  that  a  single  type  air ore ft  was  needed  to 

fulfill  the  requirements  of  both  the  Air  Poroe  and  the 

Nary.  With  this  commonality  in  Ties,  an  assumption  was 

made  from  a  oost  standpoint  .  .  .  that  a  oonmen  TFX 

would  save  about  one  billion  dollars  and  at  the  same  time 

be  versatile  enough  to  meet  both  Air  Force  and  Navy 
a 

needs.  J  This  belief  was  consistent  with  earlier  guid¬ 
ance  "to  procure  and  operate  the  force  at  the  lowest 

b 

possible  oost." 

The  assumption  that  the  TFX  was  a  suitable  system, 
meeting  botVi  the  needs  of  the  military  and  the  oost 
constraint  built  an  argument  toward  agreement  In  favor 
of  the  Secretary's  object  Its— to  build  a  foroe  of  TFX' a. 
Having  defined  the  objective,  the  next  stage  of  analysis, 
that  of  search,  was  entered  upon. 

In  the  search  stage,  the  immediate  problem  of  who 
would  produce  the  system  was  brought  Into  foous.  Using 
the  established  procedure  of  establishing  a  souroe 
selection  board,  the  Air  Force,  assisted  by  Navy 
representatives,  requested  proposals  from  ten  oontraotors. 
The  selection  board  then  developed  an  evaluation 
criteria,  and  an  evaluation  group  was  selected  who  eat 
upon  the  task  of  evaluating  the  proposals  submitted  by 
the  contractors.^  The  datA  required  and  the  time  sus¬ 


pense  established  presented  a  very  difficult  task  for 


the  competing  contractors.  The  short  tins  tuiptnae 
lent  tone  doubt  on  the  validity  of  the  ultimate  pro¬ 
posals  end  supported  e  belief  by  sons  that  some  companies 
bid  low  In  order  to  "buy  into"  the  system  and  Maneuver 
additional  funds  as  the  system  progressed.^  The 
evaluation  group,  after  review  of  the  proposals, 
refused  to  recommend  e  ©entree tor  and  proposed  that 
Boeing  and  General  Dynam I c c/Gruinarm  be  awarded  study 
oontTaots.  They  felt  this  would  stimulate  Incentive 
for  competition  from  both  the  ooet  and  design  standpoint. 

This  proposal  was  overruled  by  the  Source  Selection 
Board  who  recommended  that  Booing  be  given  exoluelve 
prime  attention.  This  proposal  wae  felt  unsatisfactory 
and  reversed  by  the  Air  Force  Council  and  the  Secre¬ 
taries  in  favor  of  competition  between  the  two  corpora¬ 
tions,  Boeing  and  General  Dynaaloe/Crumann.  Having 
accomplished  this  milestone,  the  next  stage,  that  of 
explanation,  unfolded. 

The  explanation  stage  was  set  for  12  weeks,  but 
lasted  some  ten  months.  The  details  are  not  Important 
for  the  purpose  of  this  study.  The  significance  of  the 
time  period  is  the  degree  of  "over-determination"  that 
ooourrod  in  testing  the  two  proposals.  Many  uncertain¬ 
ties  appeared  whloh  Is  normal  when  dealing  with  a  new 
systera  like  the  TFX.  It  also  appeared  to  some  that  the 


competing  oonpanles  attempted  to  exploit  the  at* tod 
requirements  of  the  Secretary  of  Defense,  that  of  ooet 
and  aoo  par  Ison,  while  not  soot  Inc  the  full  question  of 
the  Defense  objective!  to  soy  this  fooling  in  o  few 
words,  Richard  Elliott  states i  "the  TFX,  'Boot  Phone 

o 

<?ver  Built,  •  may  not  bo  good  enough . " 

Sooretnry  McNemere  entered  the  flnol  phone  of  hie 
analysis  effort,  the  Interpretation  eta  go.  He  carefully 
evaluated  the  data  presented  his  and  soda  a  recommenda¬ 
tion  in  favor  of  Oonorol  Dynaaloo/Crumann .  Ho  stated 
that  " the  General  Dynamics  program  offorod  a  greater 
opportunity  for  achieving  a  high  degree  of  dependability, 
and  at  the  lowest  possible  coet.*^  A  vital  point  in 
this  Interpretation  phase  was  that  Secretary  KeNamara 
nade  his  decision  apparently  In  basle  disagreement  with 
hi*  ohlef  military  advisors.  This  fast  leads  to  the 
next  phase  of  analysing  this  dtolslon.  Is  there  evidence 
now  that  Secretary  KoN&nara  made  a  poor  decision  or  that 
systematic  analysis  failed? 

afcai&aanla^^ 

When  treating  tho  subject  of  system  analysis.  It 
becomes  apparent  that  the  ultimate  ohoioe  by  the  decision¬ 
maker  should  be  objeotlve  and  not  subjoetlve.  Total 
alignment  one  objoctlve  may  lead  to  what  K.  M.  McKean 
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refers  to  as  on  "everdetemlRCd"  toot.  nr.  MoKean 
states  It  this  way i  "It  la  lit*  Maximizing  tho  amount 
of  aspirin  you  buy  while  simultaneously  minimizing  the 
amount  of  money  spent  for  them.**0 

Secretary  KoNamara,  while  pursuing  the  problem  of 
the  "best"  TFX  source,  possibly  violated  a  primary 
character  1st io  of  fruitful  systems  analysis,  that  of 
using  all  resources  available  to  him.  The  writer  is 
Inferring  that  some  resources  in  the  field  of  analysis 
wars  available,  but  apparently  not  utilized  fully;  i.e., 
Alain  Ebthoven  and  his  group  of  analysts. **  Also,  a 
study  by  Hand  might  have  been  of  great  benefit.  If  this 
aircraft  system  had  been  subjected  to  a  rigorous 
analysis  discipline  such  as  gaming,  with  technically 
experienced  ail  Hairy  players,  it  appears  possible  that 
the  problems  now  seen  would  have  become  apparent  and 
documented  before  tho  final  decision  was  made.  Prob¬ 
lems  such  ns  being  experienced  by  the  Navy  in  the  area 
of  size  and  weight  would  have  been  obvious  If  the 
analysis  had  consider sd  the  possibility  of  c hanging 
technology  and  tha  need  for  modifications  which  are 
oited  as  the  cause  of  the  weight  problem.  The  funda¬ 
mental  boiler  that  sysnetoo,  particularly  aircraft,  grow, 
though  known  did  not  receive  the  attention  required  of  a 
ooaplete  and  systematic  search.  Rear  Admiral  w.  1. 
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Martin  states  It  this  ways 

We  are  greatly  oonoemed  about  the  weight  (of 
the  F-lilB).  It  influences  nearly  all  of  the 
perforaanee  figure*.  ...  In  one  way  or 
another.  Weight  growth  at  this  point  oan  be 
a  very  serloue  thing*  beeauee  aircraft  are 
known  to  grow  even  after  the  Initial 
produet Ion. 12 

The  experience#  of  the  past,  In  developing  aircraft 
•yet era®,  were  olearly  understood*  but  theee  experienced 
were  not  fully  exploited. 

The  problem  of  oonoltlvlty  In  tooting  against  a 
model  is  very  Important  In  that  oertain  variables  exert 
a  far  more  significant  effect  on  the  solution  than  do 
others. *3  in  further  essoining  the  analysis  effort 
expended  on  the  TFX,  the  question  arises  as  to  whether 
or  not  this  area  of  oenoltlvtty  was  given  as  high  a 
priority  as  coat  was.  In  order  to  reset  to  now  require* 
manta  of  technology*  the  design  weight  of  the  airoraft 
will  have  to  go  up— the  only  way  to  decrease  the  weight 
Is  the  use  of  titanium*  a  vary  oostly  aetal.  While  this 
is  a  problem  for  the  contractor  and  not  the  buyer  from 
the  standpoint  of  profit*  It  is  important  because  if 
the  problem  la  not  corrected,  the  major  basis  for 
choosing  this  system— that  of  oost-effeotlvenaso— will 
as  Mr.  McNamara  onoe  oald*  "simply  evaporate."*^  Tha  TFX 
analysis  ns  McNamara  saw  It  was  a  situation  where  Judg¬ 
ments  were  pyramided  upon  Judgsente.*  ’  The  question  of 


whether  Mr.  MoNamara  violated  a  cardinal  premise  of  good 
analysis,  that  of  elimination  of  bias  through  over 
determlnatlont  may  never  be  known.  But  what  la  now 
known  Is  that  he  did  net  fully  use  all  the  resouroee 
available  to  him  In  making  his  oholoe. 

The  use  of  Mr.  Bnthoren  and  his  staff  of  analysts  In 
conducting  a  complete  systematic  analysis  would  surely 
here  Identified  the  problem  of  what  would  happen  to  this 
system  when  and  If  it  has  te  be  modified  this  way  or 
that.  They  would  have  also  looked  carefully  at  the 
question  of  whether  the  system  would  be  able  to  meet  the 
original  objectives.  Such  an  examination  might  have 
oonolnded  that  it* a  all  right  for  the  Air  Foroe  but  now 
the  Navy  oan*t  use  It.  At  this  point,  it  might  have  been 
determined  that  l;wo  of  the  basic  objectives  could  not 
have  been  met— that  of  oemisonallty  and  cost.  This  dls- 
ousslon  is  not  Intended  as  e  criticise  of  Secretary 
McNamara  but  rather  it  Is  Intended  to  demonstrate  the 
necessity  for  completeness  when  engaged  in  analysis 
effort. 

9ih SE.  ,  .fogjrJBJL. 

In  describing  systems  analysis  in  earlier  ohapters 


it  was  said  this  type  of  discipline  dealt  with  the  broad 
problems  of  higher  magnitude.  It  Is  for  this  reason 


that  the  problems  and  pitfall*  associated  with  ayeteme 
analysis  must  be  carefully  avoided.17  On  a  of  the  moot 
severe  probleae  faced  by  a  deolslcn-eaksr  la  finding 
tha  correot  typo  and  amount  of  analyst  a.  Tha  naad  for 
an  interdisciplinary  approaoh  way  find  tha  problem  of 
suoh  nature  to  be  outside  tha  available  resource  of  tha 
dooislon-maker.  That  Is,  it  nay  require  expertise,  ties, 
or  funds  which  tha  deoielon-oaker  does  not  poeeese  In 
sufficient  quantity.  This  problea  will  be  dlsouaaad 
more  fully  in  Chapter  V. 

Many  times  the  objective  is  lnoorreetly  determined. 
As  with  TFX  System  application  example.  If  more  tine  had 
bean  spent  in  determining  the  objective  in  relation  to 
tha  future  and  poaslbly  leas  intuitive  judgment  on  tha 
currant  need,  tha  ultiaata  Judgment  might  hare  been 
different.  A  good  exstaple  of  complete  eysteae  analysis 
with  clear  objectives  might  bs  tha  deolslen  on  tha  Sky 
Bolt  system.  This  was  a  lengthy,  intuitive,  yet  eys~ 
temntlo,  quantitative  study  of  current  and  future  needa. 
All  resources  available  were  placed  Into  motion  in  this 
analysis  effort.  Zt  appears  to  have  been  a  clastic 
example  of  successful  system  analysis. 

An  analysis  baaed  on  limited  objectives  may  produce 
a  logical  alternative  or  oholoe  but  Ignore  other  more 
valid  alternatives  duo  to  the  Halted  objective*  An 


example  would  be  tha  oost-efffctiveness  studies  eon- 

duotad  in  comparing  modern  aircraft  carrier*  with  other 

weapon  systems.***  "In  ©om paring  alternatives  for  limited 

war  roles,  thaae  studies#  took  no  aooeunt  of  the  oarrlere' 

general  war  capability  In  a  comparison  with  weapons  eye- 
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tone  that  had  almost  no  capability  in  other  roles.” 

Faulty  data  is  an  extremely  sensitive  problem  that 
le  always  possible  with  analysis  of  any  kind.  There  are 
several  kinds  of  faulty  data;  one  is  what  Or.  Quads 
refers  to  as  blind  aooeptanoe  of  "official  figures." 
"Official"  figures  oan  be  very  damaging  to  an  analysis 
effort  due  to  the  spectrum  they  oan  run.  What  Is  given 
as  “official"  may  be  very  bias,  very  peroohlal,  or  very 
subjective.  It  has  been  said  that  you  oan  prove  any¬ 
thing  with  statistics.  The  same  case  may  be  made  for 
improper  system  analysis  using  faulty  data.  An  associ¬ 
ated  problem  with  "official"  data  is  that  the  analyst 
may  actually  believe  his  data  to  be  oorrfeot  and  com¬ 
plete  while  this  may  not  be  true.  Wuoh  of  the  decision- 
maker’s  confidence  toward  analysts  and  their  product 
lies  In  the  standard  the  analysts  set  in  gathering  date. 
Kahn  states  that  "he  must  do  enough  cross-checking  to 
oonvlnoe  himself  that.  In  all  probability,  he  has  the 
correct  facts,  and  then  he  takes  hie  ohances."“  To 


over  cross-check,  however,  is  wasteful  and  does  not 


Improve  the  validity  or  oredlblllty  of  the  ond  product. 

Many  time*  the  limitations  of  tie#  end  money  reeult 

in  the  problem  of  VnMlBlgStPtH  1"  amlytle. 

Typically,  other  oosts  hove  the  seme  effect. 

For  lnstanoe,  we  would  like  to  find  out  whet 
the  3ovlete  would  do  If  we  put  an  armed  Minute* 
icon  on  Moscow.  One  way  ' to  get  this  Information 
would  be  to  launoh  a  Mlnutenan.  But  while  this 
might  be  cheep  in  dollars,  the  likelihood  of 
other  costa  precludes  at  once  thle  type  of 
investigation. 22 

This  problem  of  lnoomuleteneee  Involves  the  poeelbillty 
of  large  uncertainties*  especially  in  the  area  of 
military  effectiveness  or  future  strategy  or  technology. 

Finally,  there  le  the  oeemon  tendency  to  have  oom- 
petlnr  analysis  activities  confront  the  decision-maker 
with  alternative  choices  which  nay  have  been  created  to 
Influence  the  deolclon-oaker'e  choice.  If  a  design, 
model,  or  strategy  is  known  to  be  preferred,  the  deni¬ 
al  on-makar  must  make  not  only  Judgments  on  the  final 

decision  but  as  Mr.  MoNamara  states,  "also  on  the  under- 

21 

lylmr  recommendations  aud  foots."  Confidence  In  the 
objectivity  of  the  analyst  by  the  deolelon-meker  is 
necessary.  This  le  especially  true  when  the  analyst  le 
known  to  have  made  deeielona  and  Judgments  based  on  his 
best  rationale  and  intuitive  reasoning. 


46 


CHAPTER  V 


HOW  A  DECISION-MAKER  CHOOSES  A  METHOD  OF  ANALYSIS 

The  problem  of  how  a  do©  la  Ion-maker  selects  tho 
proper  method  of  analysis  la  actually  a  two-part  ques¬ 
tion,  The  question  of  whloh  method  of  analysis  to  uee 
la  dependent  on  many  factors.  Including  the  basic  second 
question  of  how  much  of  his  resources  he  should  expend. 
Many  *ho  advocate  the  use  of  systematic  analysis  in 
decision-making  find  extreme  difficulty  in  establishing 
firm  guidelines  for  the  decision-makers  to  use  in 
making  these  preliminary  decision#,  with  the  absenoe  of 
any  guidelines.  It  therefore  becomes  obvious  that  a  pre¬ 
liminary  invest lgat Lon,  or  in  a  sense  en  analysis,  by 
the  decision-maker,  must  take  place.  He  must  examine 
hi#  purpose  for  oonduotlng  the  analysis  effort,  the  com¬ 
plexity  of  the  problem,  and  the  degree  of  uncertainties 
that  exist.  Additionally,  he  must  examine  his  resources 
of  time,  money,  and  people  In  order  to  weigh  their 
relative  cost  against  effectiveness  of  results  expeoted. 
Consequently,  before  embarking  on  any  analysis  effort,  * 
critical  diagnosis  le  necessary. 
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Aocurato  diagnosis  Is  the  essential  first 
phase  of  sound  declsion-oaVlng.  Unites  the 
initial  diagnosis  is  correct,  all  subsequent 
planning  trill  be  futile.1 

This  is  the  key  to  suootss  in  asking  correct  ohoicst— 
closing  both  the  nethod  end  the  expenditure  of  resources . 

The  advent  of  aodem  systems  analysis  Is  nueh  like 
the  early  period  of  data  automation.  The  idea  that  the 
us©  of  a  computer  was  a  neoeesity  to  sll  pro  area  tire 
companies  was,  of  course,  false.  But  the  early  period 
of  computers  found  ooapenlee  obtaining  equipment  that 
was  not  oorapevtible  to  their  operation  nor  advantageous 
frost  the  viewpoint  of  eooneay*  Many  would-be  users 
obtained  equipment  prior  to  deciding  what  they  wanted  it 
to  do  for  them  or  if  it  was  worth  the  expenditure  of 
money  end  people.  This  situation  is  such  like  analysis 
efforts.  Analysis  for  anelysls  sake  is  not  reasonable 
or  economical.  Many  problems  faced  by  deoleion-oakers 
do  not  lend  themselves  to  substantial  systematic  or 
quantitative  analysis  efforts  frost  either  the  standpoint 
of  depth  or  relative  importance. 

One  of  the  major  problems  in  the  initial  diagnosis 
le  the  attitude  of  the  oeoleion-asker  toward  the  problem. 
''Organisations  do  consist  of  human  beings,  regardless  of 
how  many  machines  are  employed,  and  hence  must  be  con¬ 
sidered  ns  phenomena  of  hustn  behavior."2  This  ldsa  of 
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human  behavior  la  the  stem  of  the  problem  In  a  deo la lon- 
maker’s  attitude.  If  a  manager  It  traditionally  auto¬ 
cratic  In  pronouncing  judgment  on  problem*,  than  hla 
Initial  diagnosis  will  reflect  hla  personal  judgment 
and  has  only  a  questionable  ohanoe  of  being  correct  in 
the  majority  of  situations.  It  la  this  human  aapaot 
that  provides  one  of  the  flrat  guidelines  needed  In 
arriving  at  choices  In  methods  of  analysis  and  the 
expenditure  of  resources.  The  writer  will  oall  It 
credibility  of  the  Individual.  A  simpler  term  might  be 
experience,  but  experience  alone  does  not  always  provide 
the  objectivity  neoessary  in  a  successful  decision¬ 
maker. 

The  decialon-mnker  or  analyst  in  perceiv¬ 
ing  a  solution  may  only  be  deceived  by  the 
weight  of  his  own  preferences.  The  import¬ 
ant  task  is  not  one  of  reducing  the  human 
element  but  of  clearly  Identifying  It  and 
integrating  it  Into  the  concrete  elements 
of  analysis. ^ 

Thus  It  becomes  obvious  ;hat  while  the  leadership  role 
of  the  deolslon-maker  la  very  Important,  It  must  be  made 
credible  by  being  consistently  objective  In  decisions. 

In  choosing  the  term  credibility  In  preference  to  the 
tern  experience,  It  should  be  understood  that  only 
through  experience  can  valuable,  correct,  and  Intuitive 
judgments  be  mnde.  The  first  preralne  1r  therefore 
established.  A  credible  dooislon-mnker  must  possess 
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experience,  objeotivity,  end  an  ability  to  make  deolslons 

based  on  sound  intuitive  judgments. 

The  Ingredient  of  human  judgment  be  It  only 
the  simplest  kind  of  Intuition  is  therefore 
en  essential  part  of  any  study  of  policy,  no 
matter  how  analytical  suoh  a  study  might  be. 

Judgment  oen  be  aided  and  guided  by  the  tech¬ 
niques  of  scientific,  analysis,  but  It  can 
never  be  supplanted.4 

Having  established  the  requirements  needed  by  a 
decision-maker  and  the  need  for  preliminary  diagnosis, 
the  n^xfc  step  that  Is  neoeesary  in  making  the  Initial 
choices  of  method  and  expend lture  of  resources  In  the 
analysis  effort  Is  the  sequential  proeess. 

In  the  sequential  process  there  are  basloally  two 
decisions. 

A  terminal  decision— This  Is  a  selection  of 
the  course  of  action,  the  decision,  whloh  will 
terminate  the  sequential  decision  prooeas. 

A  continuation  decision— This  Is  a  decision 
between  continuing  to  obtain  information, 
with  attendant  time  delay  and  oost,  and  making 
«  terminal  deolslon. * 

The  problems  which  attend  most  significant  problems 
such  as  time  pressures,  oost,  utility,  and  diminishing 
return  begin  to  boar  on  the  problem.  At  some  point, 
time  nrcseures  mey  dictate  a  terminal  decision.  Time 
pressures  rnay  be  a  prime  consideration  from  the  stand¬ 
point  of  choice.  If  a  decision-maker  Is  faoed  with  a 
dynamic  deolslon,  he  must  rsaot  within  time  constraints 
with  the  most  rational  and  Intuitive  judgments  possible. 
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Systems  Analysis  efforts  are  very  sensitive  to  tine 
constraints.  The  magnitude  of  the  seriousness  of  these 
constraints  ere  directly  proportional  to  the  soope  of 
the  problem  and  the  dynamic  nature  of  the  situation. 

The  time  range  can  be  extremely  wide,  from  Immediate  to 
the  distant  future.  The  Department  of  Defense,  in  deal¬ 
ing  with  this  problem,  has  been  forced  to  react  from  both 
ends  of  the  speotrua.  James  R.  Sohleslnger  states* 

"Some  of  the  major  oholoes  of  Secretary  McNamara  were 
made  when  only  the  scantiest  oost  data  were  available 
and  when  our  understanding  of  our  strategic  objectives 
and  Soviet  capabilities  remained  obsoure  .  .  This 

clearly  describes  oholoe  as  a  result  of  tine  pressure. 

The  other  extrema  could  be  desorlbed  by  the  lengthy 
analysis  conduotud  on  the  Air  Force  B-70  system  by 
Secretary  McNamara.  The  deolelons  In  this  oase  were 
based  primarily  on  oomplete  analysis  with  much  lees 
regard  for  time  pressures  or  cost  but  more  regard  on 
eventual  utility. 

Resource  of  People 

The  resource  of  people  may  provide  a  basis  for  a 
decision-maker* s  choice  ae  to  what  type  of  analysis  he 
mlorht  undertake.  It  Is  logical  to  believe  that  In  a 
major  problem,  like  national  security,  the  decision 
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maker  will  be  Inclined  to  fooue  whatever  resources  he 
may  posseee  In  successfully  finding  oorreot  alterna¬ 
tives.  On  the  other  hand,  he  could  find  that  he  hoe 
multiple  problems  of  equal  priority  whloh  require 
analysis.  He  must  make  tradeoffs  between  these  prob¬ 
lems  .  For  example,  he  may  find  that  his  resource  of 
people  are  engaged  in  an  analyaie  of  a  problem  of  suoh 
depth  and  time  pressures  that  they  may  be  denied  to  him. 
The  decision-maker  must  then  turn  to  an  alternate  source 
for  aesietanoe  or  aooept  a  oomproalse  tradeoff  solution 
of  delaying  analysis  of  another  problem,  or  aooept lng  a 
lesser  analysis  of  both  problems.  For  example,  we  will 
assume  the  Secretary  of  Defenae  has  given  his  analytical 
staff  a  problem  on  the  nature  of  the  missile  gap.  Time 
and  national  security  dlotate  immediate  result#.  At  the 
same  time  an  analysis  of  a  problem  on  the  feasibility  of 
using  space  craft  as  a  war-making  system  is  required  by 
the  President.  The  Secretary  must  deolde  whether  he 
should  constrain  the  missile  gap  study  by  assigning  his 
staff  the  additional  and  unassoolated  requirement  to 
Analyse  the  feasibility  of  the  space  craft  as  a  war- 
maklng  system,  or  whether  he  should  turn  to  a  non-profit 
firm  ouoh  as  Rend  Corporation  or  MITER  for  the  analysis. 
In  maVlno-  his  diagnosis  he  may  determine  that  the  pro¬ 
fessional  ©xperlenoe  is  not  present  on  his  staff  snd 
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again  turn  to  tho  non-profit  group  for  the  analysis 


flagiJija. 

Ths  problem  of  oost  will  oft  an  dstoralns  both  th« 
type  and  amount  of  analysis  to  b#  conducted.  Tho  best 
way  to  dssoribe  ths  use  of  oost  as  a  method  of  determin¬ 
ing  the  effort  to  be  expended  is  the  "pay-off."  The 
oost  can  taks  many  forms.  Cost  in  money*  people*  and 
time  ere  equally  important*  bit  the  deolslon-raaker  needs 
some  basis  for  his  expenditure.  A  "pay-off"  in  terme  of 
deterrence  and  national  seourlty  may  or  may  not  be 
tangible  In  the  form  of  money  savings.  There  are  some 
problems  that  may  faos  a  decision-maker  where  oost  Is 
not  felt  to  be  of  any  slgnlf leant  importance.  An 
example  might  be  an  anelyeie  conducted  on  «  system  that 
oould  eliminate  war  or  business  failures  forever.  Even 
in  this  sense  there  is  a  "pay-off"  both  from  the  intan¬ 
gible  sonae  as  well  as  the  tangible  sense.  A  successful 
analysis  could  mean  a  reduction  in  the  intangible  threat 
of  war  and  the  tangible  oost  of  defense.  The  presence 
of  a  positive  or  negative  "pay-off"  will  dlotata  the 
decision-maker’s  choice  in  all  oases. 

The  Ultimate  3a Si 9  Of  ChOlO.s 
The  "pay-off"  to  the  decision-maker  will  always  lead 
hln  to  hie  ultimate  choice  of  method  and  amount  of 


resource  expenditure.  It  It  always  possible  to  know 
precisely  what  the  ultimate  •pay-off1’  will  be?  the 
answer  le  no.  However ,  a  basis  for  using  systems 
analysis  is  that  uneertalntles  and  unrerlflable  data 
can  be  treated  successfully.  Therefore  If  reasonable 
values  for  servloes  oan  be  established!  a  useful  •pay¬ 
off'  table  can  be  eonatruoted.  The  age  old  question  of 
"how  much  is  enough?"  oan  be  answered  by  modem  aethods. 
A  choice  of  what  is  enough  may  be  ultimately  proven 
wrong,  but  if  the  investigation  is  systematic  and  has 
reasonable  values  attached,  the  probabilities  of 
auocess  are  increased. 

There  is  a  trend  to  say  that  the  '‘pay-off"  may  be 
settled  in  the  oost-effeotiveness  ratio.  This  oan  be 
very  misleading  in  that  unless  absolute  levels  of 
effectiveness  are  specified,  the  preferred  alternatives 
cannot  be  determined.  This  oan  be  a  very  dangerous 
orlterlon  on  whloh  to  base  expenditure  of  resources. 

The  cost  or  the  effectlvsness  may  not  cover  the  problem 
completely;  thus,  the  payoff  is  inaoourete  or  inconclu¬ 
sive  Piter net Ives. 

The  reel  "pay-off"  is  where  the  decision-maker  has  e 
choice  between  a  wide  range  of  alternatives  at  various 
costs  to  him,  or  he  may  examine  a  range  of  sub-systems 
again  nt  varying  costs.  This  writer  believes  that  the 
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ultimate  way  In  whloh  a  decision-maker  oan  arrive  At  a 
fruitful  deolslon  Is  to  apply  tone  syatematlo  methodol¬ 
ogy  to  hit  daolalon  in  ohoosin*  whloh  type  of  analyala 
he  should  uae  and  how  muoh  of  hla  reaouroea  he  shou'id 
expend . 


AppJIJLc.»lto..2X. -fax.  Off-  .?»&£* 

In  Chapter  III*  a  method  of  analyala  celled  "Pay 
Off  Table"  waa  described  aa  a  uaeful  deolslon-maklnr 
tool.  Thla  table  when  oonatrueted  provides  a  decision¬ 
maker  with  uaeful  Information  from  three  considerations* 

1.  The  monetary  aspeot— an  analyala  of  the  expense 
involved  and  the  expeoted  return  In  revenue  or  eervloea. 

2.  The  aspect  of  foreoast  In*— the  uncertainty  or 
the  demand. 

3.  The  risk— how  muoh  oan  be  gained  or  lost*  Thla 
seotlon  of  the  thesis  will  show  an  applloatlon  of  a  pay 
off  table  to  the  problem  of  selecting  an  analyels  method 
and  determining  how  muoh  reaouroea  the  dec  la  Ion-maker 
should  expend  on  varying  levels  of  analysis  effort. 
Additionally,  the  model  will  provide  the  return  in 
numbers  of  alternatives  or  subsystem  analysis  he  will 

re t  and  still  have  a  profitable  analysis  effort. 

♦The  thoughts  on  pay  off  table  were  obtained  from  a 
lecture  by  Dr.  Paul  A.  Vatter, ,  "Decision  Making,"”  to 
students  of  Air  Command  and  Staff  College  lk  September  6k. 
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Soma  assumptions  mist  b*  made  in  order  to  apply  this 
type  problem  to  the  pay  off  table. 

1.  The  writer  will  present  an  over-simplified 
problem  and  model. 

?.  The  points  are  oversimplified  for  ease  in 
understanding  by  the  reader  and  does  not  constitute  a 
weakness  in  the  method. 

3.  The  values  assigned  for  servloee  are  arbitrary 
and  Are  also  Intended  only  to  provide  data  for  the  con¬ 
struction  of  the  pay  off  table. 

The  reader  must  aesuae  the  role  of  a  high  level 
deolsion-maker,  who  has  a  mullt-mlllion  dollar  system 
under  consideration.  The  system  is  unique  In  that  there 
are  many  uncerta  inties  and  vary  llttla  experlanoe  or 
date  In  the  area,  thus  an  analysis  of  ths  system  Is 
desired.  Being  u  large  and  complex  system,  the  deoist on- 
maker  wants  to  know  whether  or  not  it  will  be  profitable 
to  use  one  type  of  analysis  over  another  and  to  what 
degree  he  should  expend  his  resources. 

He  wants  to  know  how  many  valid  alternatives  ho  will 
get  for  a  given  expenditure!  also,  he  wants  to  know  how 
many  subsystems  oan  be  analysed  for  a  or  lea.  In  any 
event  he  wants  to  see  what  ths  "pay  off  of  his  various 
analysis  alternatives  will  be.  In  order  to  proceed  with 

i 

the  models,  it  must  also  be  assumed  that  there  is  a 
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value  to  the  deolelon-makur  in  having  valid  alternatives 
and  analysis  of  subsystems. 

The  decision-maker  hat  three  alternatives! 

A.  Don’t  do  any  analysis. 

B.  (1)  Apply  ten  analysts  for  six  months. 

(2)  Cost  sill  be  *100, 000. 

C.  (1)  Apply  20  analysts  for  six  months. 

(2)  Cost  sill  be  0175,000. 

(Costs  lnolude  salaries  and  analysis  expenses.} 

For  the  purpose  of  this  model,  assume  the  value  of 
each  valid  alternative  uncovered  to  be  110,000  and  eaoh 
subsystem  analysed  to  be  $10,000.  The  model  (Figure  7) 
is  an  over-simplified  example  of  the  technique  used  in 
this  type  analysis.  The  first  oolumn  on  the  left,  for 
example,  shows  only  three  ranges  of  alternatives.  This 
range  could  vary  from  rare  to  points  in  between  those 
given  or  above  the  highest  shown.  The  analysis  alterna¬ 
tives  have  been  limited  to  threej  again,  others  could 
have  been  considered. 

In  breaking  down  thle  problem  end  solving  eaoh  pert 
separately,  the  monetary  will  be  covered  firet.  Enter¬ 
ing  the  table  (Figure  7)*  the  firet  alternative  of  not 
doing  any  analysis,  all  reroes  would  be  placed  by  ell 
new  systems  alternative*!,  as  nothing  was  gained  or  lost. 
Looklnr  at  alternative  "B”  with  a  fixed  cost  of  $100,000, 
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ALTERNATIVES 

DpnAnv  Method 

20 

0  +$100,000 

+$25,000 

New  Systsa 

15 

0  +  50,000 

-  25,000 

Alternatives 

5 

0  -  50,000 

-125,000 

PIGURE  7 


it  Is  determined  that  fire  new  systems  alternatives 
would  result  In  *  lose  of  150,000  ($100,000  ooat  nlnus 
$50,000  value  of  new  alternatives) .  Using  the  sane  oost 
data  with  15  new  alternatives,  a  profit  of  $50,000  Is 
made  ($150,000  value  of  new  alternatives  nlnus  $100,000 
oost  of  analysis).  And  finally,  again  using  the  ease 
ooat  dfctftj  a  profit  of  $100,000  is  sede  ($200,000  value 
of  new  alternatives  minus  $100,000  oost  of  analysis). 

Moving  to  the  last  analysis,  alternative  *C"  with  a 
fixed  oost  of  $175,000,  we  again  enter  the  table  with 
five  new  systems  alternatives.  This  would  result  In  a 
loss  of  $125,000  ($175,000  oost  minus  $50,000  walua  of 
new  alternative).  With  15  new  eyetes  alternative,  a 
loss  of  $25,000  oooure  ($175,000  oost  sinus  $150,000 
value  of  new  systsa  alternative)  and  at  20  new  system 
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alternative,  a  profit  of  125*000  ($200,000  value  of  new 
alternative  mlnue  $175*000  ooet).  The  aspect  of  the 
monetary  consideration  haa  thus  been  handled  without 
complicating  the  next  consideration— that  of 
’'forecasting." 

We  Are  now  dealing  with  uncertainty,  the  question  of 
what  we  really  think  the  odds  are.  Using  the  model 
(Figure  7)  5*  15*  or  20  new  valid  systems  alternatives 
will  result  from  an  analysis  effort.  It  la  here  that 
work  with  the  betting  odds  begins.  We  will  say  that  the 
odds  are  one  in  two  that  w*  get  five  valid  alternatives} 
one  In  three  that  we  will  geu  15  valid  alternatives!  and 
one  in  six  that  20  valid  alternatives  are  produced.  A 
forecast  is  based  on  alternatives— with  different  like¬ 
lihoods,  hence  tie  Judgment  of  odds.  Try  and  find  the 
most  valid  odds.  Use  all  data  available  suoh  as  records 
of  past  export  one©}  look  for  different  or  peculiar 
features  that  may  affect  your  Judgment  of  the  odds.  Do 
not  let  the  monetary  aspeot  be  a  factor  In  developing 
your  forecast  or  odds. 

In  dealing  with  the  final  aspeot,  that  of  rlak,  the 
writer  will  again  simplify  ths  preblsv.  While  there  are 
many  methods  for  establishing  risk— by  utility  theories 
or  Judgment,  they  will  not  be  considered  neoeseary  for 
this  problem.  Assume  the  amounts  of  money  involved  are 


not  unusual  to  the  deolBlon-maker  oost  wise,  but.  the  pay 
off  may  be  significant  In  terms  of  alternatives  Kith 
far-reaching  values.  Therefore,  the  writer  will  aeaume 
away  the  risk  with  ®  Judgment. 

*'e  will  now  put  the  problem  baok  together.  The 
criterion  for  the  solution  of  the  problem  will  be  the 
greatest  "Fxpeofced  Monetary  Value”  (KMV  of  Alternatives 
"B"  and  "C"). 

PAY  OFF  TABLE  AKD  EMV 


Now  System 

Alterna- 

tlvea 


— *pr~ 
Don*t 

pg..Aiiy. 


20  0  +$100,000 


15  o  +  50,000 


5  0  50,000 


ALTERNATIVES 


Pore-  EViV 

cant  Date 

Oddw  "D"  "C" 


♦25,000  1/6  +16,666  +4,166 

-25,000  1/?  +16,666  -3,333 

-125,000  1/2  -25,000  -62,300 


PIOtJBE  3 

The  Index  for  the  actions  oovered  might  be  the  average 

weighed  by  the  likelihood  (odds)  that  It  will  occur.  For 

example,  the  KNV  of  •’B"  would  be* 

1/2  of  ->50,000  (-*25,000)  Plus 

1/3  of  +$50,000  (+$16,666)  Plus  ■  FI-'V  (48,312) 

1/6  of  +5)100,000  (+§16,666) 
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The  EHV  of  *Cm  would  bet 

1/2  of  -$125#  000  (-f/2,500)  Plue 

1/3  of  -12 5 #000  (-$8,333)  Hua  -  EMV  (-166,667) 

1/6  of  +125,000  (♦14,166) 

In  this  o see  wo  would  ohoooo  alternative  "8."  The 
5HV  of  +38,332  is  an  Index  of  the  desirability.  The 
larger  the  number,  the  more  desirable.  Thus#  the 
decision-maker  could  look  at  this  model  and  lte  results 
say  that  from  a  monetary,  unoertainty#  and  risk  stand¬ 
point,  alternative  "B"  is  more  favorable. 
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CHAPTER  VI 


CONCLUSIONS 

An  understanding  of  the  faotors  a  decision-maker 
must  consider  In  selecting  the  method  and  extent  of 
analysis  effort  Is  necessary  in  order  to  perform  fruit¬ 
ful  analysis  efforts.  In  previous  chapters,  needs, 
methodology,  epolioatlon,  and  problems  with  analyses 
have  o«en  treated.  The  question  of  method  and  how  much 
to  expend  In  the  effort,  oan  be  determined  if— ae  with 
the  use  of  the  pay  off  table  in  Chapter  V— an  unbiased, 
objective,  rational,  and  systematic  dleeipllne  Is  used. 
The  writer  believes  that  with  careful  attention  to 
values* ,  the  model,  and  methodology  of  the  "pay  off"  type 
analysis,  many  difficult  deoislons  a»  to  method  and 
extant  of  reeouroe  application  could  be  satisfactorily 
reached  by  decision-makers. 

It  1b  alao  oomsluded  that  careful  choloee  In  method 
of  analysis  and  expend lture  of  resonr<"',5  will  result  In 
fruitful  analysis  efforts.  Deoialon-mukers  must* 

1.  Insure  that  the  ohoioe  of  nethod  and  eTtent  of 
analysis  best  achieves  their  objective. 

?.  Hemenber  that  analysis  does  not  solve  problems 
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or  always  provide  the  most  correct  choice,  but  rather 
It  eliminate#  poorer  and  inefficient  oholcee. 

3.  Carefully  eeleot  their  diagnosis  criteria  to 
insure  that  the  aethod  and  extent  of  analysis  eeleoted 
la  relative  to  the  objective  of  the  analysis. 

4.  Be  aware  that  sound  judgment  and  Intuitive 
reasoning  in  selecting  method  of  analysis  and  resource 
application  is  still  a  baelo  requirement  when  using 
analysis  as  a  decision-making  tool. 

Recommend  that  the  Department  of  Defense  provide 
guidance  to  deo  is  ion-makers  which  will  insure  that  all 
the  factors  considered  in  this  thesis  are  carefully 
examined  before  a  method  of  analysis  or  expenditure  of 
resources  le  made. 
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